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Embedded ^knoffial jes " 



The basic question -gsked by this sturfy'was* JlOb mistakes mide whWe..^pilirig ^ 
. (nterfere with comprehen&i^ A secondary^Bii^^^s to cra^ify' the^cdni^tlng . 
views 6f Gbugrt (1972) who argyes that' the unskM fed^ reader ""would not rtfafe - ' 
hypotheses about what words jn' (he 'text shou^H Beli^ind Goodman (I976^|w^vtfj!n6. * 

■BrguB% fMat the generation of tentative hyp^thrfses abOTlj^ mea'hjng are an"^\ ^ 

.\ ^ ' - ^ ■ ■ " - -^^^^ ■ ^ ^..-:y V , ■ \ * 
inevi'tabla part of the reading 'process. Three e^pterfm^ntS were''>bo«dgcted.^^|'y^ 

"Tha first two were simulations In whJch ski 1 led'Teadfers' iBpiut SA^Mr-s^of ^ 



ages; Vifead stories which varied accord i ng^o e^rrbr fiypiiW d i f fTfiul ty , e^f'.F^br ■ 

■ ■ ' . . ^ V > ^ ■ ^ > L 4 - ■ - -^-^ ■ * - '--^ ■ - ' 

raC^ text access, and set strength* The design wafi:;^^2. x-j6^ ;pactor ial;^/ ^ 

US ing. .repeated m^astfrej, ' The thi rd experiment was^a.?natura]'f Stic compari^oh 

study, uglhg OnskJl led readies. Qveral l , the resul ts affcf"ed^ sif^pdrt for 



" bath' fi^ugh^'ind Gooj^man jl depending' on the kind of com>t?eh^sfoa- tested anjd^ 
^ , the; 1 tef fon'^fo^i^aptabrn^ responses* I t seems that ^accuracy is 

^ i'nece^afy for i'toftil s-t i c preci s iftn ; less^s&^for global Inte'rpretation, 
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Effects bft Embedded Anomal ies; and Oral Readlrigf. 

V. ^ ■ r V--.; 

. Errors on Children*! Understanding of Storjes 



The. pi^posd^ of this study was to^analyza systemat i ca t ly the relative, 

lf%ct 'be di f ferent types of^word mi s i dent If i cat ion on children's under* ^ 
* ■ ."\ \- ' . ' ' . ^ -M 

standing of connected 'di scourse. The basic question asked by the %tudy^m$fi, 

' . % .. — ' \ y ^ 

'*D6 roistakes madfi while reading interfere with comprehension?'' 



1^. \'' I Background , ' .* : ' 

Vhile Ano one would deny the fact that beginning and unski 1 led readers 
. of ten_ ml sitffefitJ fy wordSj there is a greit deal of argument among reading \y 
.researchers as whether .or not these ml sj dent i fi cat Ions interfere with 
vchi Idrero' 5 abi ri ty |to understand written material . ' . \ 

fffiere ire those, like Gbugh (1972, 35^) , who wou Id argue that.'^since 
the good. reader need 'not guess [at words] the ^bad should not." The essanee 
of the Gough view is .that* word recognition is n^t influenced or determined 
by the surrounding words In a story nor by. the reader's prior knowledge^" 
the reading, process is, too rapit for such hypotheses-testiiig to take place 
(Cosky ^ Goigh, Note 1; Gough, 1975; Gough & Cosky, 1§77)- ' Cough's research 



suggests that reading is an outside-in or bottom-'Up process, ^/n which the 
reader processes ayi of the text dafa , usingf i t as -a base from which 
meaning is then ^^nstructed. * * \ ^ ^ 

A'aecond view, sometimes referred to as top'-down and ^^^sociat^d with 
Goodman ( 1 976d.;^GQodman S Burke, 1973) ^ Mmpl les that mis fication of 

words need not necessar I ly interfere wfth the understanding teocess. 

• ■ • ■ ■ :.■ ^■•^'\ ■ ■■ 
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Goodman (1976b, p. ^f91) argues that the sXMlad readevr uses ''the least 
amount of Information possible to make the, best guesi possible," In other 



words, reading Is regarded as an insi^^^t process |n' which the reader 

makes tentative hypotheses about..the possible meaning of the text, using the 

i ._ ._ V ^ ^ . if ' ' ■ 

graphic*^ array to confU^ff*^^feCfVi se hfypotheses. The dt%ruptlv€ effect of 
^"errors, or miscues,^ depends upon the degree to which, they mat^h the tent§^ 

^ . ^ / 

tive 'meaning hypotheses urnder consideration by the reader* Those at odds 
with hypotheses will either be rejected or cai^se the reader to re^evaluate 
hypotheses , resul t I ng ^ perhaps* in some rereading of the graphic array. 



Those cons i stent 'wi th hypotheses arfe likely to be accepted at face valye; 
current hypotheses may even be strengtheried * and top-down processing Is 
likely to continue, [ . ^ 

Related Research 



The data base for ei'ther p^int of vIqw, however, is inconc!us 1 vft^ l^lOfe't 



V the one hand, it has been shown that semantical ly sensible mismatches be- ^ 
* Jfcween text and oral utterance are often accompanied by high levels o,f com" 
prehansion (Goodirnan & Burke, 1973;. Thwas,' 1975 1 Redht, 1576), thus Wdp^ 
porting the Goodrrpan view. On the' othen hand , children of^ten make, numef^owf ' 
mismatches that are not sensible yet stiil^T are able to exhibit adequate 
understanding (Biemlller, 1970; Menosky, 1971 ) ^ , — 

The inconsistency of these findings seems partly ^^e to the nnf luQ^nca 
of uncontrolled variableSp First, there is pvidehce to sug'gesty that 'tihe-\ 
semantic effects of !'errors'' of different types and from different form 
classes will vary considerably (Louthan, 1965; Spring, 1976l Weaver £ 
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I* 

Blckley, Note 2). Second, rssuits niay^well depend on how cornprshens fon is» 

measured; whether the probes rely primarily upon textual information 

background knowledge , (Tui nman & Farr, 1972; Cofer* 1973)* Third, results 

may depend on conceptual difficulty; stories cdnstructed with words and 

themes familiar to readers may tolerate a higher incidence of oral reading^ 

mismatches than i^those qonstructed with unfamlliffr words and themes,. 

One way of investigating the. above issues would be to ask a group of , 

children who vary in age, abrlity, and experience to read material s which 

differ in fami 1 iarlty, difficulty, and interest, Ora? reading errors could 

* ... 
be recorded and the degree to which different types of "errar'* interfere 

with comprehension could be measured. Yet such research would not be easy 

to condjjct because of^the fact that the experimenter Is to some extent 

under the control of (perhaps at the mercy of) the subjects. The experi- 

menter would .has^e to wait for an *'error" to occur an4 then, on the spot, 

develop some probe for assessing comprehension of the particular te^seg- 

ment In whlch^the '^error" occurred. Standard experimental criteria like 

reliability, repl i cabi 1 I ty , objectivity, and comparability of ttreatment ' 

across sub^^ects would bfe difficulty to achieve beGause of the fact that the 

number of errors, their semantic appropriateness, and their form cKass. 

would vary from subject to sybject. . 

An alternative (though less ecologically valid and hence lass satis- 

fying) procedure Is to create an exper imenti 1 simulation of word Identifl^ 

cation "errors" by embedding anomalous words in the texts, thereby forcing 

readers to use story context to make serfse of certain kinds of simulated ' 
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misidenthf ications. Jy, using a sMmulJtion design, thelreforej the qual ky, 
form'cIasSp and number of errors can be predetermioed; in'otheV words, It- 
. rs^possi ble to contror some 'of the complexity which may have confounded 
• |the, results of previous research, ^ - 

z'J ' We decidedj in the present study, to conduct a simulation experiment 
\ ,>btfcause ^&he advantage it offered In precision of measurement * and then 

to faJJow i t up with a>natural i Stic i^xperiment in order to assess the 
j jie'Jt:tent %p which *^e simulated results ware anchored in "real world'' 
« ^u^rfe^Ayig behavfor,^^ . — ... 

^ ! © " : , Overview ^ 

^■'^^f^s |fhe study consisted of three expeT'iments* The major experiment was ^ 
^'^ ■ \ ■ - ' " - ■ - \^ 

a Jsipci^\it ion designed to provide systematic control of error types and 

faotori ^soclated with them; the second experiment was a fol low^up InveS- 

' . Q ''^ V^ , . ' . . - " ^ 

^ ti gat ton ,bf the resul ts for the set strength factor In the s-lmulat ion ; the 

^ >4hf^ fex^rlment was f natural ittic ;fol lQw-up to determine the extent to 

^ ""/^ " \ ; ' - . j ■ . ^ 

' whitfh thfe simulation resul ts character I zed actuall reading behavior, 

. ^ ' ..." € • % . 

^ . " — ■ ^ ■ " 

^ . ''^ % . Experimentf Ir. Simulation ^ ^ ^ 

. /^l: ^The purpose of_ the simulation was to analyze ^the relative effects of 
^ , d1 fferent error .types on understanding by simulating the reading environ- 
ment faced by the unskilled reader who has to answer comprehens I on .ques = 
tlons. Ijt was assumed that In trying to understand a story, the unskilled 
reader Is not only faced with insufficient text dita (caused by falling to 

7 



respond at all to certain words) but anomalou^ data as well (caused by. 
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responding with a $ubstl tut ion) _ By imp^antMng simulated "errors,'* 6r . 
anomalies^ within stqf- ies /read by skilled read^rf, we hoped that the're- ? ■ '/-J 



\sulting text mterpretatdon would resemble the kind of story^ idh poQrt 

' . . f\ ■ ; ■ . -■ 

readers create when they are^unable to decode accuri«e>y al L. the ;,words i in 

the lext* We used the s Imulat ion^ dei ign in. 6rd|r to Qontrol those factors 




which are influential in the actual readTjiJ\si tuatian but which, are di 
edit to control in a naturalistic design; Th#\^iimalat ion; was corfiplex , but 
necessarily so because af the need to app'ro^imate what happens/in a^tua.l ' 
reading situations where factors ^uch as error, type, the,ir rata bf ocourr 
rence^ story di ff icul ty , text accesslbl 1 i ty , and repet i t iorr/(s^t strfength), 
seem to interact to influence chlldrefi's understanding of narrative stories. 

Method ' ^ ^ ^ ^ 

Subjects . .Eighty children (4l girls, 39 boys), all about gVears of ^ 
age, at or above grade level in reading, were selected from a mJlfdle class 
suburb of tbe Tvvin Cities, Minnesota. 

Task . Subjects read and answered questions about six stories. Each \. v 
story was transformed so that it contained simulated errors of a particular 
type. It was assumed that the proficient readers could decode the simu- 
lated errors accurately, _ 

* Materials . The stimulus materials consistedVpf 12 short narrative * 
Stories (each 100 words In length)* ill selected frQm basal reading 
jnaterial* Passage difficulty w^s varied by including six storIe|,at grada 

k level and sJx stories at grades 5=6 level (Dale s Chall, 1948; Fry., 1963). 

^ <$ ■ 
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= stories wei^e transformed by embedding different types of simulated 
e^rrorS or anbmal ffes (cal led "simulates" » avoid the connotat I ve 1 y biased 

\ teVms "error" and "miscue") in plate of randomly sel acted -noml nal s. There 
wdre six slmujate^ condiiions used^- operat iona 1 1 y defined accprdlng to 

^ their semantic and vlsua) relation to the target word: 

CORR - the. target word originally In the text.(e,g,, dragon) 
SRVU - semantical ly related, visually unrelated (e,g,, monster') 
SUVR - pemantlcally unrelated, visually related (e, g . i doctor) 
SUVU - semantical ly/vlsual ly unrelated (eJg,, rabbi^t)"^^ 
NONE a non-response (simulated by a blank space in the text) ^ 
MIX - mixed simulate type, used to simulate the naturalistic 

^situation: that Is, all simulate types except CffRR were 
Included, ^ / 

Each story was transfBrmed according to each simulate type, so that there 
were six versions of each story (see Figure 1 for the matrix of simulate 
, types for one experimental story). 



. I nsert ■Figure 1 about here 



,6 « > 




Rate of simulate subst i tut Iqn was varied fey replacing e^i ther 15 per^ 
cent or 6 percenft bf the story's words with simulates wi th^ the rgi|rjotlon 
that only nominals could be replaced with simulates (nortii 1 s'^^Sfe sel ected 
to maximize the .anomalous effect of the simulates), /he 6 percent error 
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rate was selected^to correspond to the conimDnly accepted 95 percent cri-^ 
' terion for instructional" level used by m©st informal reading inventories. 

In other words, at 6*percent error rate, according to the convf nt ional ' 
wisdom^ most children should be able to cope with the text it hand; ^The 
15 percent error rate was selected to approximate a genuinely frustrating 
situation. In general, the conventional wisdom regarding ihformal reading 
analysis suggests that error rates abov^e 5-10 percent correspond to a f rus = 
tration level for students. . .. 

\ Set strength was varied either, by repeating correct forms target 
words in the story title and later in the text (high set) or else just once 
In a story and not in the title (low set). The set strength factor'was 
included to simulate the influence of, conflicting bottom-up data/ In 
shorts what happens^to reader when he or she mUreads a word in.onfe 

tr^ . - - . ; ' . ' - .■- 

sentence but reads it correctly elsewhere? ^ 

Text access during the cqmprehenslon prpbe phase of two experiments 

was varied by allowing half of the Subjects to look back at the text>/hile 

answering quest ions whi le half the subjects were den led .access to the text. 

Text access was Included to evaluate the durability of the anomalous in- ^ 

fofmation embedded In the text. . thai: is, would stuHents be more likely 

to use' the embedded simulate when they had the opportunity to look back at 

i t, whije responding to a comprehension probe? ^ 

■ . . Dependent measures . Explicitly dependent comprehension was measured^ 
by ^sing a cloze-type measure (see Figure 1). A cloze-type rather than a 
WH-t|^pe format was used because a pilot study ry^ea led that WH=questiohs 



# 
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; ■ ■ . , ■ 9 : . 

provided additional text cues (intended to rjeduce ambigui ty) and a] so 
' tended to due the form class of the target word. For -example ^ a what or 
who question strongly suggests a nominal response while a which question 
suggests an adjectival re|ponse* Inferential comprehension was ♦measured 
by using a^ multiple choice format for implicitly dependent (text dependent) 
questions, • / 

These three quest ion types (after Pearson & Johnson , 1978) represent 
decreasing dependency on textual information* In th^ expl I c i tl y dependent 
category/ the- question and the answer are derivable from the text, and tTie 
semantic relationship between question and answer Is heavily cued by the 
syntactic structure of /the sentence from which the question is derived^ as 
In examples (1) and (2)?V . 
(l) The ghost cha&^^he bear* 

(2a) Who chased ^he bear? . ' ^ 

(2b) The chased the bear. 

Implicitly dependent comprehension corresponds tOp Pearson and Johnson's . 
textual ly imp] i ci t category, in which both .quest Ion and answer are derivable 
from the text but the rela^tionshlp between them Is not well cued by-.the 
syntax of the text, as in examples (3) and (4). 

(3) The ghost c^^ased^tbe bear. The bear ran faster. 

(4) Why did the bear rMft^faster? ' ' 

Scrlptal comprehension corresponds to Pearson and Johnson* s' scriptalTy 
dependent comprehension, rn' which theVquestion Is derivable from the text 
but the only plausible answer^must come from a reader^'i^prior experience 
or scrnptaV (after Schank, 1972)\knowlerfge, as In (5) and (6), 

■ ' 5 ' .■ ' ^ \ ^ ^- ■ ■ 
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-■ ■ ■ ■■ ' ' ■ ■ , ■ 1-0 . 

(5) The gholt^chased the bear, "^^.u -; ' 

. (6);'Why did the ghost chase the bear? ^^^^'^^^'^^ - 4$ 
Thert^measures' enabled an assessment of teomprehens ion at an^tomi. 
well as at a glpbal leyel of understarldlng. > , , 

Design and randomization procedures . The research desjgn was 
factoriah The b*^ween-subjects factors were passage di fficul ty, rate of 
' simulate substl tutfion, and text access. The repeated measures factors 
were 3imu;]ate^,type (6),, l/eve] ,--rnd.,s Random procedures In the 

development of materials and assignment of treatments were used wherever - 
Possible.. ; , ^ ^ ^ 

Procedure . The children were shown^.as an example, a short story in 
which an anomalous word occurred, Thejtory was 'd i scussed and a test 
question given, Chfldran were to:ld to hypothesi zej what the anomalous word 
in the text should mean--ln Sther words, use Context to make the best 
guess possible about the real meaning of th^ word. After a d | scuss ion "bf 
the sample story, ch i 1 dren, were g| yen the tf^^ sit of stories and , 

quest lOns^V and told tb ask for help wi th an^ words they found difficult to 
read. In brief, children were encouraged to read accurately but to *try to 
make sense of the stories they read. * ^ 

Admlnl stration . The data were c®l lected , using standardized test 
protocols, by eight graduate students, all testing taking place at the same 
time, ; ' - = ^ ^ . ■ " 

Analysis . The' cloze responses were scored accprding to a 9-point 
semantic appropriateness scale (Figure 2) and analyzed according to two , 
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dichotomous crlterla'-strict cri terion, where the exact word-was required'^ 
.for correctness ; broad "c/hter iohV v5he re re's po type's 5*9 on the. semant i< ?■ 
apprbpriatenes^ scale were scored as cor'rec^, ^ Responses were also scoVed 
according to whether'they di recti y .matched the corresponding text simulate* 



Firraliy,= inferential vcomprehension was analyzed as a fourth dependent 
measure, with two levels: Implicitly dependeht and scTlptal. ■Statistica 
piP'ocedure-S involved 5= and 4-viay ANOVAS iPor major and follow-up a^lys%^. 
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insert Figure 2 about here 



Results - . ^ ^ \ . 

Simulate type . When strict criterion scores were analyzed, there was 
a ^ain effect foil s i mu 1 ate type, £(5 , 36a][ = 93.6?, £,<v .0^ ^^ORR ' *7792f 



Post hoc comparisons I ^ using Student-N^wman=Keul s (SNK) procedures ^ showed 
that CORR and NONE were s igni fi cant 1 y superior to all other simulate types 
and different from each other. When broad criter iln SCO re| were anaiy^ed^ 
there^was also a main effect for simulate type, f(5i360) = 65.63, £ < .01 
J^ORR = -8896. - '7^58. XsuvR - •'♦563..X5^j,^j> .i*l88. X^^^^ - .6375, 

^Miv ^ 'SSS^)* Follow-up comparisons, using SNK prpceduras , showed that 
CORR, >RVU, and NONIySrespactively, were superior to SUVR, SUVU, and MIX, 

and significantly different from each other. The results, for inferential 

' " ■ • ■ ' ' .fe 

comprehension showed no main ef/ect for s imulate type, £(5,360) - I.JO, 

£> .01. Nor was there a .signif leant difference between Implicitly 
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setependent and scr i ptal , quest rons , £(1,72) " 0.77, .01, (Xj^ = .7188, 

= *6ai7). In brlftf;>afi C|n 'be swen f f^om^ R-igure J> the by^?ali resulti; 



indicated that tKe effecHs of simulate type depend on both the comprehan= 
siqntask and the criterion used to assess responses, ^The simulated errors 
were most disruptive when accuracy vyas required; less so when broad under- 
standing Was' requ^recfe; not at all when Inferential understanding was 
requi red, ' . y ' % . 



^ s Insert Figure 3 about here 

^, Set strength . When strict criterion scores were' analyzed ^ there was 
#fn7ain^%ffect fjsr set strength, F(1,72) - 37.2*4, □< .01 (xl.. - .4139, ' 
X|^g • 3285) * The results for broad criterion scoring shpwed that set 
strengtN Interacted with story difficulty, £(l,72) ^ 13.4, £ < .01 

" \p ^ .5542, m .6181, ^ .6633). These results suggest 

that^it is presumably more useful for the reader to be aware of Important 
target concepts (as in a title) before reading the story when the story 
jncludes relatfTvaly difficult content, 

Pa^ssjge diff Icultj^ . , Passage difflcurty interacted with set strength, 
tekt access, and rate of simulate substitution. The nature of the inter-" 
actions are expla Ined under the results for the other factors. 

Text access . Text access Interacted with story difficulty, £(1,72) 
- 13-10, £ < ;01 (^g - ,4306, X^^g - .3514, X^^ « '2972, X^^^ - .4056) for^ 
strict criter4ort scoring, and for broad criterion scoring, f(1 ,72) * 13*25, 
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£ <'.01 (X^g « .6722, X^^^ - ^.5792, - .5i*73, X^^p -^.6569). In order 
to analyze the interactions tuore careful lyj separate ANOVAS for easy andr 
d if f Icui t story resul ts we^re^ calGulatedV /Resu] tsVshowed no ma'in effect for 
.text access I.n d i ff I cul t stori es In favor of no-access for both strict^., 
£(1,36)^*;8.99, £< .01, and broad, £(1 ,26) - 9,27, £ < VOl , criterion " . 
scoring. Preventing the reader from looking back at difficult anomalous 
material fatllitated explicitly dependent comprehension. Results also 
showed, when matching responses (the student gave, as an answer, the exact 
simulate in* the text) were analyzed, a main effect for text access, £(1,72) 
^ 22.12, £ < .01 (X"^^ ^ .3927j \f^^ ^ .2021), What seems to happen Is 
either a "potency'' effect (as Thorndikej 1917i would have de'scrlbed It) or 
else the reader Is "pattern match i ng" (Pea rson , 1978) the question with the 
text. The simulates interfere with comprehension when text access is pos- 
sible* When access to the text is blocked , readers seem to revert to prior 
knowledge to answer questions. 

Rate of simulate substitution . Therfe was no main effect either for 
strict criterion scoring, £(1^72) ^ 0.52, £> .01 or for broad criterion 
scoring, £(1,72) ^ 3-^3,,£> ^01. The resuTts suggest that rate of error 

i 

may not disrupt comprehension unduly after a certain point, keeping in mind 
that for accurate understanding, a 6 percent nominal error rate Is already 
highly disruptive. One mus^ remember, however, that relative to the 6 per- 
cent condition, all the 15 percent condition did was to destroy the context 
surrounding the probed constituents. The very same constituents were 
probed In both the 6 and 15 percent conditions. Viewed from another ^ 

1 ^ 
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perspective, these results suggest that when cdmprehens ron*i s measured 
atomistical ly j anomal izing the surroundin.g context by an addutional 9 per^ 
-cent has no effect on chl Idren' s abi 1 1 ty to respond sensibly to such probes 
It suggests the possibility that this type of comprehehs ion is not Influ^ 
enced greatly by surrounding" context. . ' - : . 

Experiment 1% Set Strength Follow-Up 

The purpose of the follow-up was to determine whether a s i ng 1 e .repet i » 

' ■ ■ ^ ' > 

tlon of the correct word (low set).;Was any more useful than no repetition 

at all. In the low set condition^ the behavior .simulaterfl was that in which 

the reader has a chance to correct a previously mi sidentif led word. When 

this happens it is sometimes inferred (Goodman sT976a ; tlay, 1968) that the 

reader has rejectedp In memory, the previous error* If this is the case, 

then we should expect that the single repetition of the correct word after 

the Initial error would be more helpful than no repetition at all. 

Method ? ^ ^ ' 

Subjects . Ten subjects , all about 9 years of age and abo\je average 

in reading ar&i 1 i tys were selected, ^ 

Task . Subject read eight stories (four easy^ four difficult) and^ 

answered comprehension questions. 

Material s . There were four versions of Aach story T CORR, SRVU, SUVR, 

and NONE, Set strength was varied so that of the six simulates two words 

were not repeated (no set), two were repeated correctly once later In the 

story (low set), and two were present twice In their correct form, once 

later In the story and once In the title (high set). 
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Anj I y 5 [s _gnd_desxgn , The design was a 4 x 2 x 3 factorial, with re^ 
peated measures all factors. Responses were scored by strict and broad 
cri 1;erl4 arid anralyzed^ by using 3'way ANO^A procedures. 



Results and Discussion 




The results for strict criterion scoring showed a s IgtyL^^ 



effect for set strength^, F(2,216) * 6.00, d < .01 ()C,/.^r J&ll^^^, ^ .4o63, 
% " *5l88)^ Follow-up cpmparlsons. using Dunca?n"s new' jnul t i ple^range test 
(Winer^ 1971) showid that high set Was superior to low (^</. 01) with no 
difference between the np and low .set means^ (£ > .05)/ 

The results for broad cri tef ioBk scor I ng showed no main effect for set 



strength, F(2,216) = 2.2], £ ^ ' (Xj^ - .7063, = .7188, « .7938), 

I though the results were in 't[le'same direction as fofpstrict cri,te-rion 
scor i n^ 

Put briefly, the results indicated that for strict scoring the effect 
of a single repetition of the correct word did not differ from no repeti^ 
tlon at all. The broad criterion scori ng I nd 1 cated that students were re- 
markably capable of getting the semantic sense of the story even when there 
was no textual evidence to contradict an embedded anomaly. 

Experiment 3: Natural istlc Fol low- Up 
.The purpose of the naturalistic experiment was to find out the extent 
to which the simulation results characterized actual reading behavior. 
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Method * / - ^ ^ ' ^ ' ' 

. -- ' ' ■ * 

Subjects , Twenty subjects (l4 boys', 6 g j rlj) , aTI unski 1 led readers, 

. ' ^ ^ ' ' 
aged 9^12, were selected, , ^ ' 

r. H|ter.|als> Eight of the simulatidn stories in their correct versions 
(four fa^, foLy difficult) w&re used. " . 

'Prdcedure, Four treatments (the four combinations of easy or difficult 
and access or no access) were randomly assigned .to subjects. Subjects were 
testad individually., Each subject rpad each story aloud to the eKperi-- 
menter* The eKperimenter recorded all oral reading errors but paid partic- 
ular attention to errors which were made on t|^ose words which had been 
manipulated as simulates in the earlier experfments. After reading a story, 
each subject answered the six cloze comprehensidn probes and the two infer= ' 

entlal probes used in the previous experimehts* 

\ . \ ^ 

Scoring . Each time a subject made an error on one of the key words 



error was categorized according to the foutf types of errors simulated in 



(i,e,, those words for which comprehensiOfH? probes had been developed) , the 



prevIousieKper iments--SRVU, SU\/Rpi .SUVU, NOME, Then the subject ' s answer ; 



the . 

to the probe was scored corrept or Incorrect according to both strict and 



broad scoring cr-Iteria. In additioni the two^lnferential queftiop^s for 
each story ware scored as correct or incorrect. " ^ 

Analysis. D^ta were analyzed descrtptlvely. The results are reported 
in empirical probabilities. For example, a *06 means that i^n 6% of the 
cases in which students made a particular type of error, they were able to 
answer the cloze question probe correctly. In addition, the number (N) of 
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. : • M7 

such errors on which, the proportion wa,s calculated is provids^L Results 
are summed ,^no,t averaged , across subjects , . 



iesul ts and Pi souasidn- ' ■ . . ' < : ' 

Only the majn^ r©sul ts, are reported.^ For the strict scoring criterron [ 
errors p^roysd/^h Jghl'y ,dj sru^ .06, ^^ 76), They were less d^srup- 

tj W ;(£ ^V^ jflfit 76) whien th^ broad scoring criterion was^pplled, 
^^ TheresjwSre too few SRVU and 'SUVU errors on Keywords to merit analysis. 
There were 2V NONE errors and 52 SUyR errors made on key words. Using, the 
strict crlteribn, NONE errors el 1 c 1 ted more correct answers (£ « .13) than 
SUVR errors ^ .04), However* the broad scoring criterion suggested a 
reversal , wl th SUVR errors allowing more correct answers (£ - .^3) than NONE 
errors (£ * ,^.33) ^ . 

The effect of text access is somtfWhat puzzling. When students were 
allowed to look back at the stories to answer questions, they responded with 
^the SUVR error they had made while reading orally (£ ^ .43* ^. 24|^ore 
often than when they were not allowed to Iqok back (£ - .00, N ^ 28)* 
Summed aerofes SUVR and NONE errors, according to the broad criterion, no 

access was somewhat^more favorable (£ - ,iiO, N^ ^ 42) than text access , 

/ ' ^ ' , ^ ^ .. 

(£ ^ ,36., H_ - 34). ^ There were virtuafly no differences between access con- 

ditions when the strict scoring criterion was applied. ironically, looking 

back at the text- seemed to strengthen the probabi l l.ty of responding with - 

the error made during oral reading and to decrease the likelihood of a 

semantically acceptable response. These results are reminiscent of the 

access effect jn the simulation experiment for difficult stories, when 
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no-accass was more hflpful than access. Taken fn'^oncerS, these results 
'Seem' to suggest tfiat when neiding becomes ' dlfficul t , concent rat i ng on tex- \ 
tua] features is less likely. to rasult' In acceptable samantic interpretation 

' . t \ ^ ^ . ; • - ■ ^ 

» ^"than IS relying on wft^tever knowledge strtfctures have been Instarttiated In 

- ■ ^ ' 1 ^ ^ • ■ 

tlj,e prd)cess of trying to read the text, recognizing,; o^f course, that under 

. no-access conditions^ one ^has no recourse but to rely on knowledge ' '. 

^ ■ ^. h 

- structures* * . ' * . 

As in the simulation study ^ errors had' little effect on the morejglobal 

• ■ ^ ^ . ' ■ /- ^ ^ ^ 

. ".comprehension required in the 1 nfe rent ia] probes * 'Al an added analysis^ 
each oral reading'c>f each story by each student fwas^ C'lassified as exhib- 
itlng a high/rate of oral reading errors 6r a low, f,at4 of oral reading 
errors*. J the Inferential probes were examined as a function of error rate/ 
Yfirror rate affected the comprehension of Imp 1 i ci t !y^ dependent probes, with 
low error rate instances (£ = .8l) eliciting better comprehension than high 
error rate instances (p ^ .^9). In contrast, error rate did not affect 
scriptal comprehension » ,70, £^ - .70). This difference seems reason- 
able In light of ,the realization ^^at Implicitly dependent compreKens Ion re- 
Quires more attention to text than does scriptal comprehens Ton * 

■ It would strain even an ardent believer's Imagination to suggest ' that 
the natu|Sl,l St Ic results completely corroborate the results of the simu- 
lation ^fexperiment. Yet the results, for the most part, are in the right 
di rect ion. 
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- General biscussion 



The most consistent finding across all three studies is that the ne- 
tes.sity of accurate decoding depends^upon tt|4= type of cpmprehenslon one 
considers important. If one wants preci se atomistic cqmprehenslon, then 
accurate decoding seems to be a requisite behavior I f, arternativel y , one 
wants global interpretation, accurate decodi ng seems relatively unimportant. 
Hence, the incjpient tension between the Gough and Goodman viewpoints seems 
resolvable; it all depends on what goals are set for comprehension. 

There is a natural temptation to prefer global interpretation over pre- 
cise atomistjc comprehension. And in most situations global interpretation 
I' s a more desl rab^e form of comprehension, ^ Yet^, there will surely be in-^ 

stances^ particularly In Instructional settings, when it Is importari't "to 

> ~ ■- '* 

get the facts straight J- In such IristanceSj gross semantU acceptability 

wM 1 srmpiy not suffice. No matter how sincere the reader's attempt to 

■ ■ 

impose meaning onto a text that seenft to defy Interpretation, he or she 

i _ 

will quite often answer detail questions Incorrectly, 

Furthermore, semantical ly acceptable errors, because they seem so 
reasonable, are likely to disrupt precise atomistic comprehension more than 
failures to respond to overtly or semantical ly unacceptable errors: the 
child who reads "giant" as "gorilla" Is more likely to maintain that inter- 
pretation than a child who reads "giant" as "walK" 

The effect of set strength suggests that the self^correction hypothesis 
Is difficult to support empirically. Students were no more likely to reject 
an anomalous simuiate when they later encountered a correct form of the word 
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than when they did not/ On thf other hand, if the cor rect» form is made* \ 
sallent ( 1 .e^^ as ^ a par^ ^of a 1 1 1 1 e) ^ pr^j or to encpupt^rmg the anomalous [ 
simulate, then; Itudents are more likely to avercome the effect of the simu- 
late,^ We do not want to suggest that students' do not engage in s^lf-' 

correction. ^ There^s ample experimental and clinical evidence that they. , 

.['.-^ \ ' ' 

do (Goodman & Burke, 1973)* All we are bringing Into question I s the 

' . ^ / ^ • ^\ 

^ybiquity of the behavior at the same time that we suggest that there are 

.many instances in wtjich students may ndt^ recover from ml s I dent i f i cat ions . 

The failure of ratd of simulate substitution to demonstrate an effect 

suggests that atomistic comprehension Is so atomistic that It is unaffected 

by anomal izing a substantial proportion of story context. On the other 

hand, comprahens ion probes requiring a student to relate two text segments 

I ■ ' ■ ~ 

were affected by error rate In the naturalistic study. Finally, scri^tal 
comprehens ion was unaffected by error rate in any of the studies , suggesting 
its primary reriance on prior . knowledge. 

The effects of text access while answering question probes appears to 
be eounter^lntuitive. kn many instances^ students were better off when they 
could not look back at the text* Recall that In the simulation experiment 
this advantage occurred only for difficult stories. It is almost as though 
the lack of familiar content in the difficult stories disposed those stu- 
dents who had. access to the text to tryst their prior knowledge structures 
very little--a poor decision in view of the fact that those who had to rely 
on instantiated knowledge structures exhibited better comprehens I on , par- 
ticularly when a broad scoring criterion was employed. In this matter, the 
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results of the naturalistic fol. low-up study provided reasonable corrobora- 
tion. It riiay be that the' problem with text access Is that students repeat 
*thair bad-habits, thus strengthening the inappropriate response. Certainly, 
the high proportion of repeated SUVR responses when text access was per- 
mitted supports SMch an, interpretation. 

Taken as a whole, these studies suggest that teachers need to have a 
clear grasp of what they want students to gain from reading a selection* ^ 
Having made that decision^ teachers can encourage differential processing 
strategies as a function of the comprehens Ion goals they help students set^. 
Further J they can suggest to students that when they read on thfeir own ^ " 
different comprehension goals will dictate different strategies for inter^ 
acting with text, 

in terms of underlying theories of the reading process^ the data are 
appropriately ambiguous, suggesting that both the Goodman and Gough models 
must be precise about the type of comprehension under consideration* It 
is, however 4 perhaps unfair to single out theie two model s, since few. If 
any, models of reading are very specific about the nature of the task 
demands imposed during encounters with text. Indeed, recent thinking and 
research suggest the need to move toward a model of reading in which ^"1 he 
use of text data and prior knowledge structures in story understanding 
varies according to the complexity of the comprehension task^ the familiar^ 
i ty of the text^ and the level of understandi ng requl red of the reader 
(Pearson & Nicholson, Note'3| Pearson, Note k\ Nicholson S Imlach, Note 5)* ' 
Only an interactive moder like that Rumelhart (1977) has developed seems 
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. capable of . graceful ] y incorporatjrig such concerns . We admit that Rumel*hart 
has not spoken to these Issues; however^, we that such variables 

will be easier to explain In ano nteracfrvfe than In a top-down or bott^-up 
framework*^ 

it 

' . * ■ • , 

Liml'tat ions ' , / - ' 

The use of a simulation design had certain disadvantages. Generanza^ 
blllty was lost i r> simulating rather than measuring naturally occurring be- 
haviors* What was gained^j however^ was precision^^^precision in estimating 
the parameters under which certain types of oral reading behavior do and do 
not Interfere with comprehension. In addition, the naturalistic follow-up 
experiment enabled an investigation of the extent to which the s Imul at Ion 
findings were anjchored In actual reading behavior/ Nevertheless, further 
replication research in actual reading situations Is needed before firm 

. ' : " ■ ■ . \ 

conclusions can be drawn, . , . 

Future Research 

An interesting future development in studying the effects of errors on 
understanding would ^be to focus on a variety of comprehens ion tasks , such 
as the ability to retell 5 summarize, and paraphrase the event structures of 
stbries (Bower, 1976; Thorndyke , 1977; Handler £ Johnson, 1977) as well " 
as ch i 1 flren ' s quest Ion-answer ing abi 1 i ty, Future research Is also needed 
to clarjfy the effects of errors made at the proposition or paragraph level 
ratther than the word leveK' 
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Concluding Statement * ^ ■ ' . 

The results of the study stFongly suggest that future researdfi. into' . 

■ ■ ■ -^"^ 

the semantic affects of oral reading errors must take into account the way 
comprehension Is assessed. It seems clear that the necessity for precisei 
decoding depends upon whether comprehension is assessed in its atomistic 
or global aspects precision is important for atomistic detailed comprehen- 
sion, less so for global interpretation, ^> 
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Footnotes . 

'tateri when Ifitrodute independent yariablei, w# wf 1 1 use the terrn 

''si mglatt'' to d&scr ibe our ernbtdded anornaiies^ We hflve trfed toavofd, 

where ppislbli^ the i ndl scriftifriate us© of the term. '^ml scue-' or even ''sinnu-- 

lated mi scue^" becatise' of tha ipeciil meaning issigned to those terms by 

particular rpiearohers^ We ill^ reeogrilEe the fact that GDodMn (lS76a) did 

not ifiean for th^ terfn ''rnlscue'- to be appi led eHClusivaly to wgrds, although 

he does allow that there is at least a surface level similarity betv/een 

whit otheri havi called errors and what he calls mlscues (19763, p, ^99)* 

And ocaasjon^t 1y i he does use the terin error (1976bi ^$2)f although 

either ternii for SoodfU^n^ (nvolvei the stipulation that th^ reader commi t ted 

then iri his or her constarit learch for rneanlng and th^t -the reader is capabl 

;Qf Sel f^ cor recti ng th^T» v^h^ri the neinlng he iCr she l^pc^^d on thja^ te^t 

suggests correotion^ We wculd doubt, howes/er, that even Goodman would d^riy 

that, 0t the surface level at least, what he cills mfi^ueg ''look 1 m©'' what^ 

others has/e called qral reading errors or that they ' 'look like'' ml iriia tches 

J 

betwveeri y/ojds in the text jnd ^rdp readirs utter whi le reading, 
2 

Th^ lyntactic relation of siniulatei to the target words^v^as not in'= 
eluded because of the fact that'-inost word substitutions are of the same 
fornn class (Clay, IpSS^ Webar, igfiS; Goodman & Burke^ W3) ^ 

The term '^striptiP' Is^ derived from Schank's (1 9723 and Abelson*s ^ 
(1073) notion of ''scrfpt'' js a repr|sentatton of prior knowledge In mernory. 

At first glance such a flriding nilght seefn to invalidate the original 
set of liniulates chosen for the slinulatlon e^parinfient * However* one must 
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rMmmh^r that we analysed only those wrds which had been us€d as simulate 
potiticni in E^perimint V. In lact^ what is remarkible I s the high in- 
Qldtnc^ of VI sua 1 ] Y s imi la r ferrors- and the low incidence of semantically 

r 

>alittd errors among this set of noniinals* 
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Fi gure Capt ions" * . . 

Figure 1. An actual story used In the study (easy in difficulty 
level), with comprehension probes ui^d to test understandings ^(Asterisks 
indicate thoi© nominal i randomly selected for the sik percent rate con-^ 
edition. Words ci rcUd indUated high set gtrfength repetitions.) 

Figyj-e 2. 'a class If Icitlon scheme far scoring the semantic ap^roprl^ 
ateness of questiohs testing explicitly dependent comprehension. 

Figure 3^ Xha relatis/e effecti of different simulate types on e^c- , 
pllcitly dependent coinprehension vihen scored according to strict and brm^ 
Qrlteria, and on inferent lal comprehension. 



Once there was a farmer. He Kid^.lots of f 1 ne animals on 
his farm. But there was a ghost Ir* the .house, ~ ft" would 
often walk iround In the ntjht and take the sheets off 
tveryone, Soitietirtes J t knocked on the yoor^. When the 
sleepy farmer got uj^ no one was there- ^ SQnne times It 
. rol led a bottU dwn the staf ri. I t made a great nor se . 
'^One^^^^the^^^rittled all the got^ ai:id scared the ^ 
. anmals, J.\t also 1 ilAd to blw the g_Mke back down the 
eh I mney . Then rto one could light a smoke 
would go everywhere* ^thfe^^^would go out* . 

jiatrfx of S Imulatg: Types to^^^ Nomi nals 



CORR 


. SRVU ' . 


. SUVR ^ ^ 


SUVU 


fa rme r ' 


grower 


factbry ■ 


^ . ship. 


an ima Is 


livestock 


ankles 


ladders 


fa rm 


lihd 


frame 


.knffe 


ghost 


demon 


glove 


rope V 


house 


cabin * 


hose 


riven 


night 


evening 


nest 


fig 


sheets 


cloth 


sheljs 




door 


gate 


doll 


spot ' 


bottle ' 


glass 


. ba 1 1 ^ 


dust 


stai rs 


steps 


stones . 


col lar 


noise 


sound ^ 


nosp 


"-pai nt 


potB ^ 


bowls ; 


pets 


faces 


smoke ' 


fumes. 


.snaf 1 


gurts. 


ohlrnney 


^ pi^e \ ^ 


^^htcken 


forest ^ 


fire 


.bla^^ 


fish 


pie 



NONE 



MX 

grower 
Ja-nkles 
l and ■ 
■ rope 
host 

. shells 
steps 



\ 'i • Cqn>pNhens i oil Pi^ber ^ 

Expi ici tly Dependent- 
1. But there was a In the house, 

2V: It also l iked to blow fhe ; . tack dow^ 
It would of tert wal\ arou^ in the 



5^ 
6, 



lut no^pne couldMIght 
He had lots of fine 



Once '^hepe was a 



l^nferenti al • - ' 

7, Why did the farmer get up? 

A: He heard the ghost. - 

^B. He could no sleep, ^ , ^ 

C. He wanted to rack the door. 

Dfej He wanted to go dowrt^ the stairs* 



nr. 



8- Why did the^ghost rol 1 the bottle down the stai rs? 



Tixtr ' 



The dragon^ the eas^le, and the friend 



Ortce thsri wis i king, Hi livid in in. old castle, Therl wis no carpst,' Ihe walls ,wire made 
of stone. ' it WIS coid. Somitimes tie would weir i blinkst... Outs'idi tfiera lived i dragon, 
Every night he sit in his cavi oft the hill and roireci. The i<iiig could not get any sleep, 
Finplly the Icnights were sent out. iiit hs fplghtsned't'heni all iwiy from tha , Give) mipt one, 
The dragon itirtid crying; . "I havs no frisMs," Tjii i^nightjiid: "I'll bi.ycur friend.'' 
Now he livis in the ciStla. The fiji conii out of iijs nose apd keeps everyone warm. ' •' 



Tirgit Structuri: Outside theri lived i 
Ciiislflcition Sehemi; * , 



Response to Target Stimylui 




Visuilly'& 
Seinantlcally 
Idanticil 



SfuiantiGilly 
Rilatid 




Scriptilly Visually yis-uillyl Textual Simulate 
Bilivant Rilatad Siminticilly intrusion Intrusiofi ^Reiponse 
IJnrilited 



Subor- 



ordinate dinite dinati 



Dragon Monster Dinosiur'. .Cliw, GiaEft Doorbell Mter 



King 
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